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Introduction : 

Probability theory is a branch of mathematics that deals with the properties of certain structures that 
model phenomena in which 'chance' intervenes. 

of certain structures modelling phenomena in which "chance" is involved. As an abstract 

abstract mathematical theory, it is based on axiomatics and develops autonomously from physical 
reality. 

physical reality. Only the names of the concepts used (events, variables, etc.) refer to experience. 
Probability theory enables certain random phenomena to be modelled efficiently and studied 


theoretically. 


How does it relate to statistics, which is based more on the observation of concrete phenomena? 
phenomena? Broadly speaking, there are three: firstly, the data observed are often imprecise are 
often imprecise and fraught with error. The probabilistic model then makes it possible to represent 


the deviations between 'true' values and observed values as random variables observed values. 


The term probability has several meanings: historically, it comes from the Latin probabilitas, and 
refers to the opposite of the concept of certainty; it is also an evaluation of the probable nature of an 
event, meaning that a value can be used to represent its degree of certainty; recently, probability has 
become a mathematical science and is called probability theory or, more simply, probability; finally, a 
doctrine is also known as probabilism. 

The probability of an event is a real number between 0 and 1. The greater the number, the greater 
the risk, or chance, of the event occurring. The scientific study of probability is relatively recent in the 
history of mathematics. The study of probability has undergone numerous developments since the 
eighteenth century, thanks to the study of the random and partly unpredictable nature of certain 


phenomena. 


The probability of an event characterises the possibility of that event occurring, 


Chap1 : Introduction to calculating probabilities 


1.1 combinatorial analysis: 


Combinatorial analysis is concerned with studying and counting the various types of 


groupings that can be made from finite sets. 
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Combinatorial analysis comprises a set of methods that make it possible to 
determine the number of all possible outcomes of a particular experiment. 


( to count the different arrangements that can be formed from a set of 


E.g. the components of a vehicle number plate. 


Example. Numbers from a lottery draw. 


Exemple 1 : Consider a set with two elements fa; bg. With two draws without repetition, we can 
obtain {a, b} or {b, a} ; With two repeated tooks, we can obtain{a, a}{a, b}{b, a}{b, b}. 


This corresponds to a random selection. 


Exemple 2 : Let's take a set of 6-sided dice (discernible elements) numbered by {1,2,3,4,5,6}. 

After 3 throws, we obtain the realisation A = (2; 5; 1); we repeat the throws and obtain B =(5; 1; 2). A 
and B are equivalent if we consider that the arrangements are non-ordered. 

On the other hand, they are not equivalent if we are in the context of an ordered disposition. 

La valeur Factorielle(n), notée n! est définie par n! = 1: 2 n = [|i 

By convention 0! = 1. We can also use a recursive definition 


n!=n:(n-1)! 


The enumeration methods will be classified according to 3 categories: - permutations - arrangements 
— combinations 


1.1.1. Arrangement with repetition : 


Let Q be a set with n elements. If we have to choose p elements from n in an ordered arrangement 

(the places are distinct) and with repetition (we can choose the same element several times), we say 

that we have an arrangement of p elements from n. The number of arrangements with repetition is 
p 

n”. 


N.B. In this case, it is possible that p > n 


Eg 1: 

{1,2,3}. arrangements with repetitions of two elements of the set are : 
{1,2}.{1,3}.{2,3}.{2,1}.{3,1}.{3,2}.{1,1}.{2,2}.{3, 3}. 

37=9 

Ex 2: An urn contains 1R, 1B, 1N and 1V. 2 successive tosses are 
successive draws. How many possible outcomes are there? 


Probability | 2023-2024 


RR RB RN RV 
BB BR BN BV 
NN NR NB NV 
VV VR VB VN 
U 


4°=16 

1.1.2 Arrangement without repetition : 

Let Q be a set with card (Q) = n . A sample of size p (p < n) is formed, the arrangement is ordered and 
without repetition. We say that we have a non-repeating arrangement of p elements among n. The 
number of p arrangements of a set with n elements is : 


l 
P n: 


An = —————— 
” (n-p) 
Example: 


{1,2,3}. The arrangements without repetitions of two elements of the set are 


:{1,2}. {1,3}. {2,3}. {2,1}. {3,1}. {3,2}. 


1.1.3 Permutation without repetition : 
This is a non-repeating arrangement of n elements from n 


n! 
= c = n 
(n—n)! 
Example1: {1,2,3}. the permutations without repetitions of two elements of the set are : 


P, = Ah 


{1,2,3}. {2,1,3}. {1,3,2}. {2,3,1}. {3,1,2}. {3,2,1}. 


ET 3) 
no | ad 


3!=3x2=6 


A permutation of the elements of Q is an exhaustive non-remitted choice of the elements of Q, 
taking into account the order of the choice. 


Example 2: 

Suppose three teams are taking part in a tournament in which first, second and third place are 
determined. To make it easier to identify the teams, we'll refer to them as A, B and C. 

Let's find out how many different ways there are to rank these 3 teams. We can illustrate this 
reasoning with a tree diagram. 


Probability | 2023-2024 


1ère 2ème 3ème Classement 
place place place final 


Bc ABC 
— 
Cc n B ACB 


c al 
B —— A CBA 
1.1.4 Permutation with repetition : 
We call permutation with repetition of p elements where n are distinct (n < p), 
an ordered arrangement of the set of these p elements where the first appears p1 times, the second 
p2 times, etc., such that p1 + p2 +....+ pn = p. The number of permutations with repetitions is 
p! 
pi! p2! Pn! 

Example 1: [Number of anagrams for the word MATHEMATICS]: we can see that by swapping the two 
letters A, the word remains identical, but by transposing the letters É and E we get a different word 
(M :2;A:2;T:2;H:1;;1:1;Q:1;U:1;E:2) 

12! 


Anagrammes=————————————_ = 29937600 


2!X2!x2!x2!x1!x1!Xx1!x1!x1! 
1.1.5 Combination without repetition :(Set) 

Consider a set Q composed of n elements, all of which are discernible. We form a sample of size p. If 
the disposition is non-ordered and without repetition, we say that we have a combination without 
repetition of p elements among n. The number of such combinations is c? 


! 
P n: 


Ci = —— 
= p!(n-p)! 
Example: 
The combination without repetition of P=2 elements among n elements of the set {1,2,3} are 


2 3 
H= 21(3-2)! 
{1,2}, {1,3}, {2,3} 
Properties : 


1 C? =C” =1 


2. CP = CP ( complementary ) 
3. C? = C£; + C?—} (triangle of Pascal) 


n— 
~ AP 
4. CP =-—2 
P 
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p ~p—1 
Ca = Oaa t Oai i 


n 


cP i OP; — (n E 1)! (n- 1)! 
pl(n—p— 1)! (p—1)'(n—p)! 


(n—1)!- (n-p) p-(n-1)! 


p\(n — p)! pi(n — p)! 
_ n-(n—1)! 3p 
pln- p e” 


Pair formula : 


n 


(a + b)” = ` CP . aP . beP., 


p= 0 
1 
1 1 
1 1 


e 


Triangl of Pascal 
3 


Example 15 : (x + y)? = J Ckakye* = Coy? + Claly? + C2x*y! + Cia? = 


> 
o 


y? + 3ay? + 3x?y + z? 


1.1.6 Combination with repetition : 
This is an unordered arrangement of p elements, to be chosen from n discernible elements, with 
repetition. The number of combinations with repetitions of n objects taken p by pis: 


p 
Kn = Cispa 
Example: 
The combination with repetition of P =2 elements among n elements of the set {1,2,3} are : 


{1,2}. {1,3}. {2,3}. {1,1}. {2,2}. {3,3}. 
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Il Notion of set theory 


Subset: 
Let A and B be two sets such that: ACO , BCO 
We say that A is included in B, we note ACB if each element of AEB 


A and B are said to be equal, A=B if ACB and BCA if ACB. 
if ACB so card(A)scard(B) 


Complete system of events : Let A1 , A2, ... Ann events. We say that (A1 , A2 , ..., An) constitute a 
Complete system of events if they form a partition of Q : 


If their union is the certain event Q 


Jan =Q 
Q 


Union and intersection : 


AUB={w€AorwE€B} 


ANB = {w € Aandw €B} 


We interpret the event AUB as being ( A or B come realised ), and ANB as being ( A and B come 
realised ), 
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Two events A and B are said to be disjoint if they have no elements in common, i.e. if ANB=@, where 
Ø is the empty set. 


Ex: life and death 


Notion: 


| J4i=4ru aru cee ses UA, 
i=1 


Proposition : 


e Card(AUB)=card(A) + card (B) — card (ANB) 

e Intersection and reunion are laws of internal composition. 
AUB E P(Q)et ANB E P(Q) VA,B E P(Q) 

e Commutativity AUB = BUAetANB=BNA 


e Associativity : AN (BAC)=(ANB)AC=ANBAC 
AU(BUC) =(AUB)UC=AUBUC 


e Neutral event: 
AU(@)=A 
AN(Q)=A 


An (Us: = Uan Bi) 
1 i=1 


i= 


In particular A N (BUC) = (ANB) U (ANC) 
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En particulier 


AU (BNC) = (AUB)N (AUC) 
Complementary set : 
def: let Q be a set and A a subset of Q, we call the complementary set of Ain Q which we denote 


Aor CoA or A‘, the set 


02 


Subtraction of sets : 


Definition: 
Let A,B be two sets of Q, we call the difference of sets A and B which we note A\B 
We note 


A\B= {w E A and w ¢B} 


Symmetric difference: 

The symmetric difference of two sets A and B is the set whose elements belong to either A or B 
but not a (ANB). 

We note AAB 

AAB = {xEQ / xEAUBandx ¢ ANB} 
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Example : 

Considérons deux ensemble A et B 

A est l’ensemble des cadres 

B est l’ensemble des titulaires d’une administration 


A AB est l’ensemble qui réunit les cadres non titulaire et les titulaires non cadres. 


Introduction to the concept of probability 


2.1. Random experiment - event 


Definition 01 

An experiment is said to be random if the outcome cannot be completely predicted. 

We denote Q the set of all possible values that the results of this experiment can take, called the 
"universe". 

Example: 

1° / Toss a coin: Q = {P, F} 

2° / Throwing a cubic die: Q = {1, 2, 3,4, 5, 6} 

3 / Life duration: Q = R, 


Definition 02 

The set of outcomes of an experiment that verify a given property is called an event. It is 
therefore a part A of 0(A € P(Q)). 

Example: 

1° / Getting tails by tossing a piece of money. 

2° / Obtain a sum 2 7 by simultaneously throwing two pieces of money. 

* The set Q is an event called a certain event. 

* The set @ is an event called an impossible event. 


* Two events A and B are said to be incompatible if ANB=@ 
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Definition 03 


An elementary (simple) event is a part of Q reduced to a single element (E={w}). 


Definition 04 
We call a complete system of events any P — ulpet(Ay, Az, A3 seg) of events or sequence of 


events (A,,)n>1 two by two incompatible distinct from Ø such that: 
p 
UJ Ay = 0 
k=1 


Axiome 01: 
0<P(w,;) <1 


Axiome 02 : 


5 P(w;)=1 


i=1 


2.1.1. Probability: 
Let Q be a probability set, A is a subset of Q 


P: (P(Q)) - — — —> [0,1] 
_ card(A) 
Rees P(A) ~~ card(Q) 
We can write 
Number of favourable cases 
PA) = 


Number of possible cases 


2.1.2. Equiprobability : 
If all the elementary events have the same probability, we say that there is equiprobability. 


Example: 
In a throw of the dice 


1 
> ie hahaa hsh 


10 
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2.1.3. Tribute: 

Let be a fundamental set and is another set, B a subset. We say that is a tribe (also called an algebra) 
if it satisfies the axioms : 

1° /QCA 


22°/BEAD>BCEA 


3°/ Si (By). is a sequence of elements’ belonging to A _ then 


p 
(Jer EA 
k=1 


Example 

Q = {{a}, {b} {c}} 

A, = {O, {a}, {b}, {c}} is not a tribute 

A, = {Ø, {a}, {b, c}, {a, c}, {b, a}, {c}, {b}, {a, b, c}} is a tribute 


2.2 Probabilised space 
2.2.1. Kolmogrov axiomatics 
Let Q be a set. A tribe on Q We call probability on (Q,A) any application 


Checking 

1° /P(Q)=1 

2° (Ai)ier iS a family of two distinct elements of A ( i.e.) 
Aj NA; = Ø. Y i,j 


p 
P Ua =) PA) 


iel 
Definition: The triplet (Q,A,P) is called a probability space. (Q, A, P) 


Definition: The cardinal of a set Q, denoted card (Q), represents its number of elements, for example 
O={1,2,5,8}> card (Q)=4 


2.2.2. Elementary probability 


1°/P(@)=0 

2° P(A) = 1 — P(A) 

3° / P(A) < P(B)siACB 

4° P(A U B) = P(A) + P(B) — P(A N B) 


Definition (Probability (finite case)) A probability P is a function of P(Q) 
in [0; 1] such that : 


> P(A U B) = P(A) + P(B) si A et B sont disjoints 


11 
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> ANA=@,AUA=Q 
> (ANB) =AUB 

> (AUB)=ANB 

> 


si (A c B) alors A c B 
> card(A)=card(Q) — card (A) 


Probability of events. 

The probability of an event is a numerical value that represents the proportion of times the event will 
occur when the experiment is repeated under identical conditions. We can deduce from this 
definition that a probability must be between 0 and 1 and that the probability of an event is the sum 
of the probabilities of each of the elementary events that make it up. Finally, the sum of the 
probabilities of all the elements of O is 1. 


Space of observables : 

In each situation, the space of observables (or outcomes) is therefore denoted Q, while the elements 
of Q, called observations, will be denoted w. Let's look at some examples of how we model a random 
experiment. 


Definition: 

Any set of finite cardinal is called a finite probability space (it is also called a state space, or universe 
Q). 

An event is a set of outcomes (a subset of the universe) of a random experiment. Since an event is a 
statement about the outcome of an experiment, we need to be able to say, for any outcome in the 
universe, whether the event happens or not. 


Example 01: 

Consider a 6-sided die, numbered 1 to 6. The set of possible outcomes of a throw is called Q = {1; 2; 
3; 4; 5; 6}. Assuming that the die is balanced, we associate the probability 

probability 1/6 to each result. We therefore think of a probability as a function P on Q such that : 

P(1) + P(2) + P(3) + P(4) + P(5) + P(6) = 1: 


Example 02: 

We consider the same die, except that on the sixth face the number 6 is replaced by 5. There are 
therefore two sides with 5 on them. The set of results is different: A = {1; 2; 3; 4; 5}. 

As the die is balanced, faces 1, 2, 3 and 4 each have a probability of 1/6 of coming up, 

P(5) = 2/6. 


For example, si Q = {1; 2; 3}, 
Then P(Q) = {Q; {1} ; {2}; {3} ; {15 2} 5 {1; 3} ; {2; 3} ; (1; 2; 3} 


2.4. Independent conditional probability: 
Let (O,A,P) be a probabilised space, the intersection of two events denoted ANB where only if both 
events A and B are realised. However we can be interested in the realisation of event A knowing that 
event B has already been realised, if this event has a non-zero probability i.e. we are interested in the 
conditional probability knowing B. 
The conditional probability knowing B is the application of €[0,1] defined by : 

P(ANB) 


12 
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Incompatible event: 
A and B are two incompatible events if and only if (ANB)=@ 
Example: 
A candidate takes a competition 
A: successful 
B: failure 
C: absence 
A and C are incompatible. 

e Incompatible events A and B: 
Event A will not occur if event B occurs: 

P(A|B)=0 


P(A U B) = P(A) + P(B) 


Example 1: 

Two dice are thrown and the two events are considered: 

- A: obtain an odd number on both dice ; 

- B: the sum of the points obtained on the two dice is an odd number.. 


A = {1,3}, {1,5}, {5,3}, {1,1}, {3,3}, {5,5} 
B = {1,2}, {1,4}, {1,6}, {3,2}, {5,2}, {3,4}, {3,6 44,5}, {6,5} 
(A N B) = Ø > A et B sont disjoint 


2.5. Independence of events : 

2.5.1. Definition 

Event A is independent of event B if the probability of occurrence of event A is not modified by 
information concerning the occurrence of event B.Event A is independent of event B if the 
probability of occurrence of event A is not modified by information concerning the occurrence of 
event B. 


Meaning 
P(ANB) = P(A) x P(B) S ALB 
Then we say that A is independent of B 


The principle of compound probabilities leads to : 


P(A | B) = P(A) 


Compound probability theory 
This principle translates into Poincarré's formula 
P(A, N AZ NN An) = P (A1) + P(A2 | A1): P(A3 | A1 N A2) = P(An | A1 N Ag N An-1) 


Example 01: (examination) 

There are 6 machines in a box, 4 of them are in working order and 2 are broken. Three machines are 
chosen at random, one after the other. 

Find the probability that the 1st and 3rd are working and the 2nd is a defect. 


Solution: 
Bi: "the i machine selected is in good condition". 
We are looking for the probability P (B4 N B3 N B3) 


P(B, N B3 N B3) = P(B1)P(B2/B1)P(B3/B1 N B2) 
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Example 2: 

We have 7 balls, 4 white and 3 black. 

Select 3 balls in order and without a restart. 

Calculate the probability that the three balls are white. 
Solution : 

Consider 

B1: a white ball on the 1st selection. 

B2: a white ball on the 2nd selection. 

B3: a white ball on the 3rd selection. 


P(B, N B2 N B3) = P(B1) x P(B2/B,) x P(B3/(B1 N B2)) 


= 4/7 x 3/6 * ?/5 = */35 
2.5.2 Pairwise independence 
To judge B4, Bz, Bz to be independent of each other, it is necessary that 
P(B,9 B2) = P(B2 N B3) = P(B, N B3) 
2.5.3 Mutual independence 
The events A;,i E€ (1,2,...,n) are mutually independent if for any part | of the set of indices we 


have : 


P (a a = | [Pa 


iel 


iel 
Example: 
We throw two dice and consider the events: 
A: The first die has an even face ; 
B: The second die has an odd side; 
C: The sum of the dots on the two faces is even 


A = {2,4,6} 
B = {1,3,5} 


14 
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3 1 1 18 
P(A) =F =5 PB) =z ,P(C) = 36 
P(A N B) =purple 
P(A n C) =blue 


P(C NB) =green 
9 1 
P(ANB) = P(ANC) = P(C NB) = s l > A,B,C are independent two by two 


P(A NB NC) = 0 + P(A) x P(B) x P(C) 


Events A, B and C are not mutually independent: 


2.5.5. Bayes theory 


Definition 
The subsets Aj, A *| An of the set Q are said to form a partition of Q if 


2°/ ANA; =Ø,Y1<ij<n 


Theorem: Let (Q,A,P) be a probabilized space A; a partition of Q then we have the following 
realization V B E€ A 


1°/ Total probability formula : 


P(B) = ) (BNA;) = ) P(B/4;) x P(A) 
a 
2°/ Bayes formula : 


P(B/Aj) x P(Aj) _ P(B/Aj) x P(Ai) 


PAB) = ——“popy “Ih P(B/AD PAD 


Exercise : 


A series of urns contains the following balls: 


2B 3B) 5B 
1N AN|’ 3 |2N 


A white ball has been drawn from U, what is the probability of it being drawn from Uy 


U = ,U = 


_ P(U,NB) _ P(B/U) x P(U;) 
P(U,/B) = -Pe PCB) 
P(B/U,) x P(U;) 
P(B n U) + P(B NU) + P(B N U3) 
P(B/U1) x P(U1) 
P(B /U1) x P(U1) + P(B/U2) x P(U2) + P(B/U3) x P(U3) 
Al x If, 


(2/3 x 1/3) + (3/7 x 1/3) + (F/ x 1/3) 


15 
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